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SHOW-THROUGH COMPENSATION APPARATUS AND METHOD 

This application is a continuation-in-part of co-pending U.S. Patent 
Application 09/200,984; filed November 30, 1998. 



Field of Invention 

This invention is directed to document scanning and printing apparatus 
and methods that compensate for show-through of images from a back side of a 
translucent document and a document adjacent the translucent image when scanning 
the documents. It is particularly directed to the copying or scanning of such 
documents when they are bound together, e.g., pages of a book. 

Description of Related Art 

When a user wishes to reproduce an image on an image bearing 
substrate [any document] or obtain an electronic version of the image on the 
document, the image is passed within a detection field of an optical sensor. The 
passing of the document image within the detection field of the optical sensor is 
termed "scanning" the document. The optical sensor detects light reflected from the 
surface of the document and obtains data representing the reflected light. The data 
obtained is an electronic representation of the images formed on the document, 
because the colors and shadings of the images reflect different amounts and 
wavelengths of light. 

When a double-sided translucent image bearing substrate, having 
images on both sides of the image bearing substrate, is scanned, the electronic 
representation generated by scanning one side of the image bearing substrate will 
contain information from both sides of the image bearing substrate due to light 
passing through the image bearing substrate. The high contrast image information of 
the scanned side, or front, of the image bearing substrate will be combined with the 
low contrast image information from the back side of the image bearing substrate. 
This low contrast image information from the back side of the image bearing substrate 
is called "show-through" image information. Similarly, when such a translucent 
document is scanned while adjacent a similar document, e.g., copying pages from a 
bound book, then some text or images from the adjacent page may also "show- 
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through". The elimination of residual signature in the scan of the back side and the 
adjacent document is the problem to be overcome by the subject development. 



place a black backing on the back side of the image bearing substrate during scanning. 
The light that passes through the image bearing substrate is absorbed by the black 
backing. Although there is a significant reduction of the show-through image 
information, there is a small residual low contrast image of the back side remaining in 
the scanned image due to light scattering off the back side of the image bearing 
substrate- This method is undesirable because with a black backing any perforations 
in the image bearing substrate and regions beyond the edges of the image bearing 
substrate appear as black regions in the scanned image. Additionally, trying to insert 
such a backing for book scanning is particularly inconvenient and undesirable. 



printed documents have been previously been described in U.S. Patents 5,832,137 and 
6,101,283 to Knox. A description of the art can also be found in G. Sharma 
"Cancellation of Show-through in Duplex Scanning", Proceedings International 
Conference on Image Processing, Sept. 10-13, 2000, Vancouver, Canada, Vol. II, pp. 
11-609-612. 

Summary of the Invention 

This invention provides apparatus and methods that compensate for 
show-through of images from a back side of a translucent image bearing substrate 
document and an adjacent side of another document disposed as a backing for the 
image document when reproducing the images. 

Image reflectance data for a front side and back side of an image 
bearing substrate and the adjacent side of a backing substrate is obtained from an 
optical sensor that senses light reflected from the substrates. The image reflectance 
data is stored in a memory and is used to determine scanned density data for the front 
side and approximate effective absorbency data for the combination of the back side 
and the adjacent side of the substrates during the scanning. 

In accordance with an imaging model proposed here, show-through 
compensated density data for the front side image is obtained by subtracting a low 
pass filtered version of the effective absorbency data for the combination of the back 
side and the adjacent side from the scanned density data for the front side. A point 



One way in which show-through image information is reduced is to 



Methods for compensation of show-through in the scanning of duplex 
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spread function for the low pass filter is estimated either statically or adaptively in 
accordance with standard linear prediction theory. The show-through compensated 
density data for the sides may be transformed back to show-through compensated 
reflectance data for each side. 
5 The adjusted image data may then be stored in memory for later use 

when reproducing the image. In this manner, a reproduced image with no show- 
through may be obtained. 

Brief Description of the Drawings 

10 Exemplary embodiments of the apparatus and the methods of this 

invention will be described with reference to the following figures, wherein like 
numerals designate like elements, and wherein: 

FIGURE 1 is a functional block diagram of one exemplary 
embodiment of a show-through compensation system according to this invention; 
15 FIGURE 2 is an exemplary functional block diagram of the show- 

through removing device of Fig. 1; 

FIGURE 3 is an exemplary diagram of an image on the front side of an 
image bearing substrate and an image on the back side "showing through" to the front 
side; 

20 FIGURE 4 illustrates the light paths that occur when scanning an 

image bearing substrate that does not have an image formed on it; 

FIGURE 5 illustrates the light paths that occur when scanning an 
image bearing substrate that has images on both the front side and the back side of the 
image bearing substrate, and an image on a backing sheet to the substrate, as in the 
25 scanning of the bound pages from a book; 

FIGURE 6 is a flowchart outlining an exemplary method for adjusting 
detected image data to remove show- through image information according to this 
invention; and 

FIGURE 7 is a flowchart outlining in greater detail one exemplary 
30 embodiment of the method for removing the show-through image information of step 
S900 of Fig. 6. 
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Detailed Description of Preferred Embodiments 

Figure 1 shows a functional block diagram of one exemplary 
embodiment of a show-through compensation system 10 according to this invention. 
As shown in Fig. 1, the show-through compensation system 10 includes an optical 
5 sensor 100, a show-through image information removal device 200, an image data 
source 300, and an image data output device 400. These devices are coupled together 
via data communication links 110, 210 and 310, respectively. These communication 
links 110, 210 and 310 may be any type of communication link that permits the 
transmission of data. For example, the communication links may be direct serial or 

10 parallel connections, a local area network (LAN), a wide area network (WAN), an 
intranet, the Internet, circuit wirings and the like. 

The optical sensor 100 is any type of device that detects light input and 
translates the light input into image data. For example, the optical sensor 100 may be 
a scanning array of photosensitive sensors such as CCDs or photodiodes which are 

15 controlled to sense light reflected from an image bearing substrate. The optical sensor 
100 may be a single sensor or a plurality of sensors. Additionally, the optical sensor 
100 may be deployed as a two-dimensional array, for instance the type used in a 
digital camera. 

The optical sensor 100 provides image data to an image data source 
20 300 via the communication link 110. The image data source 300 stores the image 
data in memory. The image data source 300 provides the image data to the show- 
through image information removal device 200 via the communication link 210 when 
show-through image information is to be removed. The show-through image 
information may be removed immediately after the image data is obtained or may be 
25 removed at some time after the image data is obtained. Furthermore, show-through 
image information may be removed when adjusted image data is to be sent to the 
image data output device 400. 

The show-through image information removal device 200 adjusts the 
image data to compensate for the effects of show-through image information in the 
30 electronic image data generated by scanning the image bearing substrates. The image 
data is adjusted to generate adjusted image data, which is output to the image data 
source 300 via the communication link 210. 

The image data source 300 is any type of device that is capable of 
receiving the adjusted image data and supplying image data to the image data output 
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device 400. For example, the image data source 300 may be a computer, a 
microprocessor, a scanner processor, a disk drive, a tape drive, a hard disk, zip drive, 
CD-ROM drive, DVD drive, a network server, a print server, photocopying device or 
any other known or later developed device or system that is able to receive and 
5 provide image data. The image data source 300 may include a plurality of 

components including displays, user interfaces, memories, disk drives, and the like. 
For simplicity of the following description of the preferred embodiments, it will be 
assumed that the image data source 300 is a personal computer. 



10 from the show-through image information removal device 200 and provides the 

adjusted image data to the image data output device 400 over the communication link 
310 when the image is to be output. The image output device 400 is any type of 
device that is capable of outputting an image. For example, the image output device 
400 may be a laser printer, bubble jet printer, ink jet printer, photocopying machine, 

15 cathode ray tube (CRT), computer monitor, television, camera, or any other known or 
later developed device or system that is able to generate an image on a recording 
medium or display an image using image data or data generated from the image data. 
The image output device 400 generates an image based on the adjusted image data 
from the image data source 300. While Fig. 1 shows a single image output device 

20 400, multiple image output devices 400 may be coupled to the image data source 300. 



single device. For example, the optical sensor 100, the show-through image 
information removal device 200, the image data source 300 and the image output 
device 400 may be contained within a single device such as a digital copier, a 
25 computer with a built-in printer, or any other integrated device that is capable of 
outputting an image. Similarly, the optical sensor 100 and the show- through image 
information removal device 200 may be integrated into a single device, such as in a 
scanner or the like. 



30 and the image data source 300 may be combined into a separate integrated device 
attachable upstream of a stand-alone image output device 400. For example, the 
show-through image information removal device 200 and the image data source 300 
may be an integrated device which interfaces with both the optical sensor 100 and one 
or more image output devices 400. For example, the show-through image information 



The image data source 300 stores the adjusted image data received 



Any combination of the elements of Fig. 1 may be integrated into a 



Alternatively, the show-through image information removal device 200 
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removal device 200 and the image data source 300 may be incorporated into a 
programmed general purpose computer, a network print server that manages printer 
data for a plurality of the same or different printer devices, and the like. 

Furthermore, the show-through image information removal device 200 
5 may be implemented as software executing on the optical sensor 100, the image data 
source 300 or the image output device 400. Other configurations of the elements 
shown in Fig. 1 may be used without departing from the spirit and scope of this 
invention. 

The term "image", as used herein, refers to any image containing any, 

10 or all, of one or more halftone images, continuous tone images, line art or other 

graphics images, and/or any compilation of text, that is capable of being displayed on 
a display device or output on an image bearing substrate. For example, an image may 
be a combination of graphics and text that is stored in the image data source 300. The 
image may be a series of pixel values denoting the color, intensity, and/or any other 

15 known or later developed image property of the particular pixels that make up the 
image. Although most book scanning primarily involves black and white text, the 
invention is applicable to color images causing the undesired show-through effects. 
Extension to color on a per channel basis is straightforward from the exemplary 
embodiments discussed herein. 

20 The optical sensor 100 detects light reflected from the image bearing 

substrate and translates the detected light into image data that is provided to image 
data source 300 and, in turn, to the show-through image information removal device 
200. The show-through image information removal device 200 adjusts detected 
image data to remove any show-through image information and forwards the adjusted 

25 image data to the image data source 300. The image data source 300 stores the 
adjusted image data and outputs the adjusted image data to the image data output 
device 400 when the image is to be output. 

When the optical sensor 100 is used to detect reflected light from the 
image bearing substrate, the image bearing substrates are scanned. For book scanning 

30 this comprises sides (pages) 1 and 2 of a book sheet and a side 3 comprising the 

facing page of an adjacent sheet. The first scan of the image bearing substrate is the 
front side (side 1) of the image bearing substrate, the second scan of the image 
bearing substrate is the back side (side 2) of the image bearing substrate, and the third 
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scan is of the adjacent sheet (side 3) disposed as a backing to the substrate during the 
scan of the first side. 

Thus, each scan of the image bearing substrates provides different 
image data corresponding to the image on the side of the image bearing substrate 
5 scanned with some show-through of the image on the opposite side of the image 
bearing substrate and the facing side of the adjacent backing substrate. The image 
data for the scanned sides of the image bearing substrates is provided by the image 
data source 300 to the show-through image information removal device 200. 

Figure 2 is a block diagram of one exemplary embodiment of the 
10 show-through image information removal device 200 of Fig. 1. As shown in Fig. 2, 
the show-through image information removal device 200 includes an input/output 
interface 201, a controller 202, a data alignment circuit 203, a memory 204, and a 
show-through image information cancellation device 205. These elements are 
connected to one another via the control/data signal bus 206. 
15 The image data is provided to the show-through image information 

removal device 200 by the image data source 300 via the communication link 110 and 
the input/output interface 201. The controller 202 causes the image data sent by the 
image data source 300 to be stored in the memory 204. 

Once the image data is received from the image data source 300, the 
20 controller 202 instructs the data alignment circuit 203 to align the image data 
corresponding to the front side of the image bearing substrate with image data 
corresponding to the back side of the image bearing substrate and the facing side of 
the backing substrate. The back side image data will be reversed from the front side 
and facing side image data. Thus, when comparing information for two sides, the 
25 back side should be reversed so that the images will correspond. 

After reversing, the front side image data should be aligned with the 
reversed back side image data and the facing side image data. Because the images are 
acquired at different times, or by different sensors, they are not necessarily scanned 
with the same spatial reference. Skew alignment, lateral shifts, and linear distortions 
30 of the images all may be required. 

When the front side and the back side images are scanned using 
automatic feeding means, these adjustments can be determined from the geometry of 
the scanner, or by a calibration process which scans a test target and notes the spatial 
displacement of target features. The data alignment circuit 203 may also perform 
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alignment determinations based on, for example, alignment marks on the image 
bearing substrates or an image bearing substrate support, edge detection, or any other 
known or later developed alignment method. 

The alignment requirement may be relaxed through the choice of filters 
5 used to determine show-through cancellation values, as discussed in more detail 

below. Thus, exact alignment is not necessary to practicing the invention. However, 
some alignment is desirable to reduce error in the show-through cancellation 
determinations. Additionally, aligning the image data may be omitted and the data 
alignment circuit 203 omitted from the show-through image information removal 

10 device 200 without departing from the spirit and the scope of this invention. 

In one exemplary embodiment, once the image data is aligned by the 
data alignment circuit 203, the show-through image information cancellation device 
205 cancels the show-through image information from the image data. To cancel the 
show-through image information, scanned density and absorbency functions of the 

15 front, back, and facing side image layers are computed and show-through 

compensated densities of the images are computed by subtracting filtered absorbency 
data from the scanned density data. The resulting adjusted image data is stored in the 
memory 204 and then output to the image data source 300 via the input/output 
interface 201 and the communication link 210. 

20 Figures 3-6 illustrate one exemplary method for adjusting image data 

to compensate for the show-through image information. The method described with 
reference to Figs. 3-6 is only exemplary and is not meant to limit the invention to any 
one method. Rather, any method for compensating for the show-through image 
information that uses linearized density functions, or approximations thereof, to 

25 compensate for the show-through image information may be used without departing 
from the spirit and scope of this invention. 

Figure 3 shows the image data generated by scanning a front side of an 
image bearing substrate image that includes show-through image information of an 
image from the back side of the image bearing substrate. As can be seen from Fig. 3, 

30 the vertical line 20 shows through from the back side of the image bearing substrate 
and is present in the image data of the image 30 of the letter "A" generated from 
scanning the front side of the image bearing substrate. 

Figure 4 illustrates the light paths that occur when scanning a 
translucent image bearing substrate using a non-black backing. In the example shown 
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in Fig. 4, the translucent image bearing substrate does not have any images formed on 
it. Light 122 from a light source 120 is directed upon the translucent image bearing 
substrate 130. The light 122 from the light source 120 is incident on the front surface 
of the image bearing substrate 130. Portions 124 of the light 122 are scattered by the 
5 image bearing substrate 130. Other portions 126 of the light 122 are transmitted 
through the translucent image bearing substrate 130. 

The portions 126 of the light 122 transmitted through the translucent 
image bearing substrate 130 are reflected by the non-black backing 140 back through 
the image bearing substrate 130 to an optical sensor 150. While Fig. 4 shows the 
10 reflected light 126 being reflected at a large angle, in actuality this angle is quite small 
and is considered to be zero. The figure is illustrative only and is not meant to be 
limiting in any way. 

The reflectance R p w detected by the optical sensor 150 may be 

represented as: 

15 

Rp W = S p + T p 2 Rback (1) 

where: 

R p w is the reflectance detected by the optical sensor 150; 
20 S p represents the fraction of portions 124 of the light 122 that are 

scattered; 

Rback represents the reflectance of the non-black backing; 

and 

T p represents the fraction of portions 126 of the light 122 that are 
25 transmitted through the image bearing substrate. The subscript p denotes a paper 
image bearing substrate and the superscript w in R p w indicates that this is the 
reflectance for paper that is without print on either side (white). However, this 
invention is not limited to using paper, but may use any image bearing substrate. 
Thus, Eq. 1 shows that the reflectance Rp VV detected by the optical sensor 150 is the 
30 sum of the fraction S p of the light 122 that is scattered and product of the backing 

reflectance Rback and the square of the fraction T p of the light 122 transmitted through 
the paper is used to represent the amount of light that is transmitted through the paper 
image bearing substrate to the non-black backing, reflected therefrom and further 
transmitted back through the paper image bearing substrate to the optical sensor 150. 
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Figure 5 is a graphical diagram illustrating the light paths that occur 
when scanning a book wherein show-through image data results not only from the 
front and back sides of a single image bearing substrate, but that additional show- 
through image data occurs from a backing sheet adjacent to a scanned sheet. The 
5 following discussion assumes that the front and back sides images are black and white 
images. However, as will be apparent to one of ordinary skill in the art, similar light 
paths will occur with color or gray scale images. 

As shown in Fig. 5, light 122 from the light source 120 is incident on 
the image bearing substrate (sheet 1) 130. Portions 124 of the light are scattered by 
10 the front side of the substrate 130. The remaining portion 126 of the light 122 is 

transmitted through the front side. The fractions of the light 122 that are scattered and 
that are transmitted depends on the characteristics of the image formed on the front 
side of the substrate 130. 

The portion 126 of the light 122 transmitted through the front side of 
15 the image bearing substrate 130 is then transmitted through the back side of the image 
bearing substrate 130. Portion 127 of the light 122 that is transmitted through the 
back side of the image bearing substrate is dependent on the characteristics of the 
image on the back side of the image bearing substrate and the image bearing substrate 
itself. 

20 The transmitted portion 127 of the light 122 is then reflected back from 

the backing 140 through the back and front sides of the image bearing substrate to the 
optical sensor 150. The portion 128 of the light 122 is dependent on the 
characteristics of the image on the adjacent side of the backing sheet 140. The portion 
129 of the light 122 represents the portion of light that is transmitted through the back 

25 side of the substrate 130. Portion 129 may not be the same as portions 127 or 128 
since some of the portion 127 will be absorbed by the backing 140 or may be 
scattered by the back side of the substrate 130. The portion 131 of the light 122 
represents the portion of light passing through the front side of substrate 130. This 
portion 131 may not be the same as portion 129 due to, for example, the spread of 

30 light through the image bearing substrate 130. 

In the preferred application of the subject invention, substrate 130 
comprises pages 1 and 2 as the two sides of a duplex printed sheet of paper and the 
backing 140 is composed of an adjacent sheet and the following sheets (with page 3 
on the top of the backing sheet 140.) A white paper substrate both transmits and 
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scatters light. Let S p denote the fraction of light that is scattered upward by a sheet of 
paper and T p denote the fraction that is transmitted by a sheet of paper. The paper 
appears white in color because it scatters much more light than it transmits (T p « S p ). 

When page 1 is viewed from the top, as shown in Fig. 5, the image 
seen is attributable to the combination of the light rays that are scattered by the sheet 
of the paper and those that are transmitted through the sheet of paper, reflected back 
and retransmitted through the paper. The spatial reflectance profile corresponding to 
this view of page 1 (this is what is sensed by a scanner scanning page 1 with the 
remaining pages forming the backing) can be approximated as: 



Ri s (x,y) = T! 2 (x,y) S p + T, 2 (x,y) V T 2 2 (x,y) R 3 s (x ? y) (2) 



where x,y, denote the spatial coordinates, Ti(x,y) is the transmittance of the image 
layer on page 1, T2(x,y) is the transmittance of the image layer on page 2, and R3 S (x,y) 

15 is the spatial reflectance profile of page 3 viewed from the top with subsequent pages 
of the book forming the backing. Note that the right hand side of Eq. 2 is the 
summation of two terms, the first of which corresponds to the part of the incident light 
that is scattered back by sheet 1 and the second of which corresponds to the part of 
light that is transmitted by sheet 1 . Note also that the second term depends on the 

20 transmittance T2(x,y) of the back side image layer (on page 2) and the reflectance 
R3 S (x,y) of the pile of sheets forming the backing to sheet 1 . This dependence of the 
(scanned) reflectance of page 1 on page 2 and the backing represents undesired show- 
through. The goal of show-through correction is to remove this undesired 
dependence. 

25 

Show-through corrected Image for Page 1 

For consistency's sake, the term "show-through corrected image for 
page 1 " refers to the image that would have been obtained if only the front face of 
page 1 were printed and there was no printing on the back side (page 2) or subsequent 
30 sheets of paper. Using this definition in Eq. 2 we can see that the reflectance for the 
show-through corrected image of page 1 is obtained by setting the transmittance of 
image layer 2 to unity (T 2 (x,y) = 1 ) and the reflectance of the "backing" to the 
reflectance for a pile of blank sheets (R3 S (x,y) = R p w ): 
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R,(x,y) = T, 2 (x,y) S P + T, 2 (x 5 y) T p 2 R p v 



(3) 



where Ri(x ? y) is the reflectance of the show- through corrected image of page 1 and 
R p w is the reflectance of a pile of blank sheets (no printing anywhere). Note that 
5 alternate definitions of show-through corrected image may be used without impacting 
the following analysis or the applicability of the method. 

The goal of show-through correction is to recover the reflectance 

Ri(x,y). 

1 0 Reflectance for a Pile of Blank Sheets 

Consider a large pile of paper bearing no printing on any sheet. Let 
R p w denote the reflectance of this large pile of paper. Since there is not printing on 
either side, we can use Eq. 2 with Ti(x,y) = T2(x,y) = 1 to obtain: 



15 



Rn 



Sp +■ Tp R p w 



(4) 



20 



where the reflectance term corresponding to the backing has been replaced by R p w 
because with a large pile of imprinted paper removing a sheet of paper will not change 
the reflectance in any significant way. Eq. 4 indicates that the reflectance of a large 
pile of imprinted paper can be computed from the scattering and reflection properties 
of paper as: 



R p w = Sp/(l-T p 2 ) 



(5) 



25 



30 



Note that through a similar argument it can be seen that S p corresponds to the 
reflectance of a sheet of paper with a black backing, and (S p + T p 2 ) is the reflectance 
of a sheet of paper with a perfectly reflecting white backing. Also observe that 
substituting (5) in (3) a simpler expression is obtained for the reflectance of the show- 
through corrected image of page 1 : 



R,(x,y) = T, 2 (x,y) (S p + T p 2 R p w ) = T, 2 (x,y) R p v 



(6) 
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Linearized Model of Show-through 

For reasons that will become clear later, it is advantageous to express 
Eq. 2 in normalized density space, where the normalized density is obtained as the 
negation of the logarithm of the normalized reflectance, obtained by dividing 
reflectance of the pixel with the reflectance for a pile of blank sheets: 



Di s (x,y) =-ln(R, s (x,y)/Rp w ) 

= -ln(T, 2 (x,y» - In ((S p +T P 2 T 2 2 (x,y) R 3 s (x,y) )/R p w ) 

= -ln(T, 2 (x,y)) - In (Sp/R p w + T p 2 T 2 2 (x,y) R 3 s (x,y)/R p w ) 
10 = -ln(T, 2 (x,y)) - In ((1 - T p 2 ) + T p 2 T 2 2 (x 5 y) R 3 s (x,y)/R p w ) 

= -ln(T, 2 (x,y)) - In ( 1 - T p 2 [ 1- T 2 2 (x,y) R 3 s (x,y)/R p w ]) 
= D, (x,y) - ln{ 1 - T p 2 [1 - T 2 2 (x,y) T 3 S (x,y)]} (7) 



where ln(.) denotes the natural logarithm, and 

D,(x,y) ^ -In (R,(x,y)/R p w ) = -ln(T, 2 (x,y)) (8) 

(see Eq. 6) is the normalized density for the show-through corrected image for page 1, 
and 



T 3 s (x,y)^R 3 s (x,y)/R p w (9) 

is the normalized reflectance corresponding to the scan of page 3. 

25 Since T p « S p <1 and all other reflectance and transmittance terms in 

Eq. 7 are bounded between 0 and 1, we can see that 0< T p 2 [ 1 -T 2 2 (x,y) T 3 s (x,y) ] «1 . 
Therefore, we can use the approximation: In(l-x) ~ -x for | x | « 1 
in Eq. 7 with x = T p 2 [1-T 2 2 (x,y) T 3 s (x,y)] to get: 

30 D, s (x,y) k D,(x,y) + T p 2 [l-T 2 2 (x 5 y)T 3 s (x,y)] 

«D,(x,y) + T p 2 A 23 e (x,y) (10) 

where 

35 A 23 e (x,y) = [1 -T 2 2 (x ? y)T 3 s (x,y)] (11) 

Note that Eq. 10 states that the density corresponding to the scan of page 1 is the sum 
of the density for the show-through corrected image for page 1 and a show-through 
component that is equal to the effective absorptance A 23 e (x 5 y) multiplied by the factor 
40 T p 2 . 
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Spreading in Paper and Show-through Point Spread Function 

The spatial spreading of light in the paper is neglected in the derivation 
of Eq. 10. The spreading of light in paper can be incorporated through a simple 
empirical modification by replacing the factor T p 2 of Eq. 10 by a "show-through point 
spread function" H (x ? y) to obtain 

D, s (x,y) = D,(x,y) + H(x,y) * A 23 e (x 5 y) (12) 
where * denotes the spatial convolution operation. 



Show-through Correction 

From Eq. 12 it is clear that if Di s (x,y) , A23 e (x 5 y) and H(x 5 y) are known 
the density Di(x,y) for the show through corrected image can be recovered using the: 

Di(x,y) = D, s (x,y) - H(x,y) * A 23 e (x,y) (12.1) 

To see how the terms Di s (x 5 y) and A23 e (x ? y) can be obtained, first note 
that R p w (the reflectance of a (thick) pile of blank sheets) can be estimated directly 
from the scans by averaging over margin areas in which there is no printing on any 
page (this is the reason why the normalized density was defined as in Eq. 7). Di s (x 5 y) 
can then be obtained from the scanned reflectance Ri s (x ? y) for page 1 using the 
relation (see Eq. 7): 

D, s (x,y) s -In (Ri s (x ? y)/R P w ) (13) 

A23 e (x 5 y) can be estimated using Eq. 1 1 , with the normalized 
reflectance T3 S (x ? y) obtained from Eq. 10 by using the scanned reflectance R3 S (x,y) for 
page 3, and the transmittance T2(x 5 y) for the image layer on page 2 approximated as: 



T 2 2 (x,y) = R 2 s (x 5 y)/R p w (14) 



where R2 S (x,y) is the scanned reflectance for page 2. By considering an equation 
similar to Eq. 7 for the case scanning page 2 5 we can see that this approximation is 
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obtained by neglecting the show-through in the scan of page 2. It can be readily seen 
that the error introduced in the show-through correction due to this approximation is of 
the order of T p 4 and therefore usually negligible (note that the transmittance of paper, 
T p , is quite small). If necessary, this approximation error may be further reduced by 
5 using an iterative approach in which the scanned reflectance in Eq. 14 above is 
replaced by the show- through corrected values from the last estimate. 

Alignment and Show-through Point Spread Function 

In order to apply the show-through correction described by Eq. 12, one needs 
10 to know the show-through point-spread function H(x ? y) and the relative alignment 

between the scans for pages 1, 2 and 3. Approximate alignment can be determined by 
detecting the edges of the pages, if any remaining alignment error does not vary over 
the page (i.e., there is no skew or other distortions) the theory of optimal linear 
filtering, for example as described in Simon Haykin, Adaptive Filter Theory, Prentice 
15 Hall, 1991 , can be used to determine the point spread function from regions of the 
scan in which there is no printing on page 1 and corresponding regions of scans from 
page 2 and page 3. Alternately, if there are (small) variations in the alignment over 
the page, adaptive linear filters (for example, as described in Simon Haykin, Adaptive 
Filter Theory, Prentice Hall, 1991) can be used for the estimation of the show-through 
20 point spread function. If the relative alignment between the scans of pages 2 and 3 
also varies over the page (as will normally be the case), two separate adaptive filters 
may be used and adapted independently, one representing the show-through due to 
page 2 (adapted and directly used in regions where there is printing in page 2 and no 
printing on pages 1 and 3) and another representing the show-through due to page 3 
25 (adapted and directly used in regions where there is printing in page 3 and no printing 
on pages 1 and 2). In other regions, the filter coefficients can be used to "register" the 
images on pages 2 and 3 relative to each other and cancel show-through using 
estimated A23 e (x,y) and one of the filters. 

The use of adaptive filters has a significant advantage over non- 
30 adaptive filters in that the registration of the front and back side images is not required 
to be extremely precise. As long as the filter sizes are reasonably large, they can 
adapt and compensate for small changes in the registration. 

Note that one could potentially think of using the mode of Eq. 2 
directly for the correction of show-through in reflectance space. However, the 
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method would require perfect alignment of the images and a separate method of 
estimating the show-through point spread function. The use of density space provides 
a nice linear approximation to the problem allowing the use of theory from linear 
filtering in the estimation of the show-through point spread function, and also the use 
5 of adaptive filters which can significantly reduce the requirements for alignment. 

Reflectance Data for Show-through Correct Image 

Once the density for the show-through corrected image for page 1 is 
obtained, reflectance corresponding to this show-through corrected image can be 
1 0 readily obtained as: 

R 1 (x ? y) = R p w ln(-D 1 (x 5 y)) (15) 

As noted earlier, Ri(x,y) corresponds to the reflectance that would 
1 5 have been obtained if there were printing on page 1 alone and page 2 and the other 
pages forming the backing were blank (note there is no objectionable show-through in 
this case). 

The show-through adjusted image data is stored in memory and may 
also be stored in the image data source 300 for later use in outputting the image using, 
20 for example, the image output device 400. 

Figure 6 is a flowchart outlining one exemplary embodiment of a 
method of compensating for show-through image information in image data. As 
shown in Fig. 6, beginning in step S500, control continues to step S600, where the 
image data is input. Next, in step S700, the image data is stored. Then, in step S800, 
25 if necessary, the image data is aligned. Control then continues to step S900. 

In step S900, the image data is adjusted to remove any show-through 
image information. Then, in step S1000, the adjusted image data is stored. Next, in 
step SHOO, the control routine ends. 

Figure 7 is a flowchart outlining one exemplary embodiment of the 
30 method for adjusting the image data of step S900 of Fig. 6. As shown in Fig. 7, 

beginning in step S900, control continues to step S910, where the (spatially varying) 
scanned density of the front side of the image bearing substrates is determined based 
on the image data from the scanning of the pages. As described above, this may be 
done using the detected reflectances and the first line of Eq. 7 for the front side. 
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Next, in step S920, the approximate transmittance of the back side 
image and the normalized reflectance of the adjacent side image is determined from 
the scan data. This may be done, for example, using Eqs. 14 and 9. In step S925, the 
back side transmittance and the normalized reflectance of the adjacent side image are 
5 combined to obtain the effective absorptence of the combination. Eq. 1 1 may be used 
for this. Then, in step S930, the show-through point spread function of the image 
bearing substrate is estimated. As described above, this approximation may be 
performed automatically using linear prediction filters to approximate the show- 
through point spread function. Control then continues to step S940. 

10 In step S940, density for show-through compensated front side of the 

image bearing substrate is determined from the scanned densities, the approximated 
absorbencies, and the estimated show-through point spread function. This may be 
done, for example using Eq. 12.1. Then, in step S950, show-through compensated 
reflectances for the front side image is computed, for example, by using Eq. 15. Next, 

15 in step S960, control returns to step S1000 in Fig. 6. 

The above described equations may be applied to each pixel, group of 
pixels, and the like, of an image either through hardware, software, or a combination 
of hardware and software. The choice of hardware or software may depend on the 
speed and efficiency requirements of the system on which the show-through 

20 cancellation is implemented. Note also that for the conversion from reflectance to 

density the natural logarithm was used as an illustrative example in the description of 
the preferred embodiment, a logarithm to any other base may be used equally 
effectively, as the use of a different logarithm base only changes the "density" by a 
multiplicative factor. Furthermore, for the purposes of efficiency the functions for 

25 "density" and "absorptance" defined in this disclosure may be replaced by suitable 
equivalents or approximations that may be computed faster or evaluated using look- 
up tables. Also while the preferred embodiment has been described with reference to 
the scanning of black and white or grayscale images the invention is directly 
applicable to color images where the operations are performed on a perchannel basis. 

30 Additionally, it is understood that the entire images are not needed for the realization 
of the invention described herein and the show-through compensation may be 
employed by using buffers that make available required parts of the images on the 
three relevant pages. 
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As shown in Figs. 1 and 2, the show-through image information 



removal device 200 may be implemented on a general purpose or special purpose 
computer. However, the show-through image information removal device 200 can 
also be implemented on a programmed microprocessor or microcontroller and 

5 peripheral integrated circuit elements, an ASIC or other integrated circuit, a hardware 
electronic or logic circuit such as a discrete element circuit, a programmable logic 
device such as a PLD, PLA, FPGA, or PAL, or the like. In general, any device on 
which a finite sate machine capable of implementing the flowcharts shown in Figs. 6 
and 7 can be used to implement the show-through image information removal device 

10 200 of this invention. 



thereof, it is evident that many alternatives, modifications and variations will be 
apparent to those skilled in the art. Accordingly, the preferred embodiments of the 
invention as set forth herein are intended to be illustrative, not limiting. Various 
15 changes may be made without departing from the spirit and scope of the invention. In 
particular, the different functions described herein may be approximated, for example, 
using look-up tables for efficient implementation. 



While this invention has been described with specific embodiments 
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